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In the late 1940's while he was trying to construct 
a model for self-reproduction, a machine equiva- 
lent to biological systems, von Neumann invented 
a class of discrete mathematical systems called cel- 
lular automata ^ . Almost thirty years after the in- 
vention cellular automata underwent a radical ref- 
ormation when, in the early 1980's, Wolfram con- 
sidered them as general mathematical representa- 
tions of complex systems in nature His inves- 
tigations on cellular automata led him to the con- 
viction that the laws for complex systems cannot 
be formulated as conventional mathematical equa- 
tions; he proposed that the evolution of these sys- 
tems can be correctly described only in the form 
of algorithms, the kind that are used in computer 
programs. It was the beginning of a new branch 
of science which Wolfram originally called the sci- 
ence of complexity. This new branch of science is 
based on the notion of computation 0] . According 
to Wolfram the evolution of any system, natural or 
artificial, can be viewed as a computation for which 
the initial state of the system is the input and the 
state that emerges after a given interval of time is 
the output. Cellular automata provided the ground 
for the discovery and the development of this new 
science. 

Cellular automata are discrete dynamical sys- 
tems defined on discrete space - an array of finite 
geometric cells, e.g, in the form of a lattice - and 
evolve in discrete time, i.e., time that changes in 
finite steps. The state of a cellular automaton is 
the set of the simultaneous states of its component 
cells. The function of each cell is defined in terms of 
a discrete dynamical variable that has a finite set of 



values and each value in this set denotes a distinct 
state of the cell. A cellular automaton evolves by 
updating the value of the dynamical variable simul- 
taneously at all the cells forming the discrete space; 
this parallel updating is the primary feature of cel- 
lular automaton dynamics. The updating occurs at 
each step in discrete time. All updates follow a sim- 
ple deterministic rule. The rule states, in terms of 
an algorithm, how the state of each cell (determined 
by the dynamical variable) changes after each time- 
step, influenced by itself and the states of the other 
cells in a well defined neighborhood. In the simplest 
cases, called elementary cellular automata, a two- 
valued variable x G {0,1} evolves simultaneously at 
all the cells z of a one-dimensional lattice by means 
of an updating rule F that defines the interaction 
of each cell with its two nearest neighbors: 
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Since each cell has two possible states there are 
2^ different states of the three cell neighbourhood 
{xi-i, Xi, Xi^i} and each of them maps to a new 
state of the central cell i for which there are the 
same two possibilities as there are for all other 
cells. Consequently there are 2^ — 256 different 
updating rules F for elementary cellular automata. 
Evolution of two different kinds, reversible and ir- 
reversible, are shown in Figs.^andl^ Ref. [5j con- 
tains an overview of cellular automata. 

The construction of cellular automata was moti- 
vated by the fact that natural systems, both phys- 
ical and biological, are made of a large number of 
elementary units. Each unit has a simple structure 
and performs a simple function. However, when 
these are connected together by local interactions. 
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the resulting assembly (that forms a natural sys- 
tem) often produces extremely complex behavior. 
Besides, natural systems are inherently dissipative. 
Consequently they evolve in a manner that is ir- 
reversible and self-organizing, i.e., ordered struc- 
tures are generated spontaneously from disordered 
initial forms. Cellular automata are mathematical 
systems that possess similar features. Like natural 
systems they are comprised of many identical units, 
each very simple, that evolve simultaneously by lo- 
cal interactions into complex ordered states. The 
unit of all cellular automata is a geometric cell in 
discrete space with a dynamical variable describing 
its state. Most of the updating rules are irreversible 
and generate self-organized states. Wolfram began 
his research on cellular automata with the aim of 
discovering the laws of self-organization. Accord- 
ing to the second law of thermodynamics an iso- 
lated system spontaneously evolves to a state of 
maximum entropy and hence, of maximum disor- 
der. The proof of this statement assumes that the 
microscopic evolution rule (i.e., the updating rule 
for each unit of the system) is reversible. Instead, 
if the microscopic evolution rule is irreversible, this 
particular restriction due to the second law of ther- 
modynamics no longer exists and Wolfram showed 
that a system may evolve from a disordered state 
to a more ordered one. This is the origin of self- 
organization in most cellular automata. At each 
time-step of evolution the state of a cellular au- 
tomaton has a unique successor, since the updat- 
ing rule is deterministic. If the rule is reversible the 
predecessor of each state is also unique and the set 
of all allowed states of the cellular automaton re- 
mains constant under its evolution. However, if the 
updating rule is irreversible, several distinct states 
may evolve to one particular state which means 
that the predecessor of a state is not necessarily 
unique; unless the state in each time-step of evolu- 
tion is memorized, the cellular automaton has no 
way of retracing its history when the direction of 
time is reversed. Therefore the set of allowed states 
of the cellular automaton contracts as it evolves and 
the limiting set of ordered states that ultimately re- 
mains is only a small subset of all possible initial 
states. This process of selecting a specific subset 
of all possible states forms the mechanism of self- 
organization. In cellular automata, the information 
on the specific subset to be selected is encoded in 
the updating rules. Though the updating rules are 



simple it appears that the outcomes of the evolu- 
tion of most cellular automata are impossible to 
predict; this, according to Wolfram, is the mark of 
a complex system. Wolfram thus adopted cellular 
automata as the appropriate mathematical repre- 
sentations of the complex systems occurring in na- 
ture. However Wolfram's definition of a complex 
system is only qualitative: a system that is not 
obviously simple; it still lacks a definition in quan- 
titative terms. 

The evolution of cellular automata are found 
to be equivalent to computations, i.e., cellular 
automata perform like digital computers. Besides 
self-organization, this is the other important 
feature of cellular automata. In general, each 
cellular automaton can perform a specific compu- 
tation when provided with a specific form of the 
initial state. For example, the elementary cellular 
automaton that follows rule 132 (in Wolfram's 
nomenclature scheme ,2;) can effectively compute 
the remainder after dividing a natural number n 
by 2 if it is assigned the initial state that contains 
a block of n consecutive cells in state 1 and all 
other cells on both sides of the block are in state 



0. The updating rule is expressed as 
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The outcome of the evolution of this cellular 
automaton tells whether a given natural number 
n is even or odd. If n is even, the cellular au- 
tomaton evolves to a state where all the cells are 
in state 0; if n is odd, it evolves to a state that 
contains a single cell in state 1. Some cellular 
automata are known to be capable of universal 
computation, i.e., they can perform any possi- 
ble computation with appropriate initial states. 
One of the earliest known examples is the two 
dimensional cellular automaton 'Life' invented by 
Conway [HI C] . The simplest of all those that have 
been proved to be universal is the cellular automa- 



ton that follows elementary rule 110: 
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proof is indirect: the elementary cellular automa- 
ton with rule 110 was shown to emulate any given 
cyclic tag system and it was possible to construct 
a cyclic tag system that emulates any given Turing 
machine; since some Turing machines are known 
to be universal computers, it establishes that rule 
110 is capable of universal computation. The 
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computational capability of cellular automata led 
Wolfram to the view that all processes in nature 
are programs composed of simple algorithms in 
the form of cellular automata. 

Wolfram's research on cellular automata for al- 
most two decades has been recorded in his book 'A 
New Kind of Science' jS]- The book is an outstand- 
ing collection of computer experiments and each 
set of experiments culminates in a remarkable dis- 
covery or proposition, two of which must be men- 
tioned. While studying the evolution of reversible 
cellular automata from various initial states, Wol- 
fram discovered that there are certain reversible 
cellular automata that, contrary to the existing be- 
lief, do not obey the second law of thermodynam- 
ics. Some of these reversible automata never evolve 
to disordered states from ordered ones; there are 
others that are found to self-organize from disor- 
dered initial states to configurations with ordered 
structures that are reminiscent of the outcomes of 
irreversible evolution. Though Wolfram has stud- 
ied a vast number of cellular automata, the laws 
of self-organization have not been found. However, 
the results of these computer experiments led him 
to propose 'the principle of computational equiva- 
lence'. In a general way, the principle states that 
'almost all processes that are not obviously simple 
can be viewed as computations of equivalent so- 
phistication' [2] . The principle makes a remarkable 
assertion that there is just one level of computa- 
tional sophistication. Though it is still in the form 
of a hypothesis. Wolfram believes that this princi- 
ple is a new law of nature. 
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Figure 1 : The evolution of two elementary cellular au- 
tomata with reversible updating rules: (a) the left shift 
automaton: xf'^^^ = I'^i^i, and (b) the right shift au- 
tomaton: x'f'^^'' = xf2i- In Wolfram's nomenclature 
scheme [5| these are called rule 170 and rule 240 re- 
spectively. Each diagram shows an array of 65 cells 
evolving for 32 time-steps. Time increases in the down- 
ward direction. A white square denotes a cell in state 
while a black square denotes a cell in state 1. In 
both cases the initial state of the cellular automaton 
contains a single cell in state 1 whereas the rest of the 
cells are in state 0. This simple structure of the initial 
state is maintained throughout the evolution. If the fi- 
nal state in each case is considered as the initial state 
by inverting the diagrams (equivalent to reversing the 
direction of time) the evolution of each automaton is re- 
traced when the respective updating rules are applied; 
this happens because the shift automata are reversible. 




Figure 2: The evolution of two elementary cellular 
automata with irreversible updating rules. In Wol- 
fram's nomenclature scheme these are called (a) rule 

mod 2, and (b) rule 150: 
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^ + xl"' + x^^'j mod 2. As in Figure 1, 

white and black squares denote cells in the states and 
1 respectively and the evolution of an array of 65 cells is 
shown for 32 time-steps from an initial state which con- 
tains a single cell in state 1. Time increases downwards. 
It is clear that the simplicity of the initial state is de- 
stroyed as the automata evolve and an ordered struc- 
ture emerges in each case. These cellular automata fail 
to retrace their evolution if the direction of time is re- 
versed, which proves that they are irreversible. 
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